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Abstract. We consider a family Uof finite universes. The second order quan- 
tifier QsH , means for each U £ U quantifying over a set of n(lH)-place relations 
isomorphic esto a given relation. We define a natural partial order on such 
quantifiers called interpretability. We show that for every Qtji , ever Qjk is 
interpretable by quantifying over subsets of U and one to one functions on U 
both of bounded order, or the logic L{Qrj^) (first order logic plus the quantifier 
Qgi) is undecidable. 
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1. Introduction 

1.1. Background. In this work we continue Xii but it is self contained and the 
reader may read it independently. Our aim is to analyze and classify second order 
quantifiers in finite model theory. The quantifiers will be defined as follows: 

(*) Let J7 be a finite universe, and n a natural number. Let K he a, class of 
n-place relations on U closed under permutations of U . Define Qk to be 
the quantifier ranging over the relations in K. 

We will usually work on quantifiers of the form Qr ~ Qkr where i? is a n-place 
relation over U and Kr is defined by: Kr := [R' C "C/ : (C/, R) « [U, R')}. We de- 
fine below two partial orders on the class of such quantifiers, called: interpretability 
and expressibility. It will be interesting to consider the class K of n-place relations 
definable in some logic £, that is such that there exists a formula ip{r) e £ (r is 
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a n-place relation symbol) and i? G X iff {U,R) |== ^{r}- In [2] the problem was 
solved for the case: K is definable in first order logic and U is infinite. It was shown 
that in this case Qk is equivalent (in the sense of interpretability) to one of only 
four quantifiers: trivial (first order), monadic, quantifying over 1-1 functions or full 
second order. A revue paper of this result is 3 . If we do not assume Qk to be 
first order definable but keep assuming U is infinite we get a classification of Qk 
by equivalence relations. Formally from 4 we have: 

Theorem 1.1. Let U be an infinite countable universe, and K be as in (*). Then 
there exist a family E of equivalence relations on U , such that Qk and Qe are 
equivalent (each is interpretable by the other). 

We remark that if U is infinite not nessesarily countable then the situation is 
more complicated, but if we assume L — V then we have the same result. JL, deals 
with the case U is finite. Under this assumption we get a reasonable understanding 
of Qn, we can "bound" it between two simple and close quantifiers (close meaning 
that the size of one is a polynomial in the size of the other). Formally: 

Theorem 1.2. Let U be a finite universe, and R a n-place relation on U . Then 
there exist a natural number A — X{R), and equivalence relation E on U such that 
uniformly we have: 

(1) Qe and Q\^^ are interpretable by Qr (Q]^^ is the quantifier ranging over 
1-1 partial functions with domain < A. 

(2) // \U\ > A" then Qr is expressible by {Qe^QI'^^}- 

(3) // \U\ < A" then every 2-place relation on a subset A C_ U with cardinality 
< |C/|^/^" is interpretable by Qr. 

Where "uniformly" means the formulas used to express and interpret are indepen- 
dent of U and depend on n alone. 

In case (2) of the theorem if we want to have "interpretable" instead of "ex- 
pressible" then the situation is more complicated and we deal with it in this paper. 
Since C/ is a "large" universe we check the "asymptotic behavior" , that is we con- 
sider a class 11 of finite universes with unbounded cardinality. For each U € illet 
9^[C/] C "[/ be an rt-place relation on U. We will see that there is a dichotomy y in 
the behavior of Qm[u]' ^^^^ relates to cases (1) and (2) of theorem 11.21 Formally 
we prove: 

Theorem 1.3. Let 9^ be as above. Then exactly one of the following conditions 
holds: 

(1) (5fK[;7] is uniformly interpretable by 1-1 functions and 1-place relations both 
of bounded cardinality. 

(2) For each m £ N, there exist [/ G it such that we can uniformly interpret 
number theory up to m, by Q<y\[u] . 

We prove this theorem in sections 3 to 6. In section 3 we analyze the situation, 
and give a condition for the dichotomy. In section 4 we prove that if the condition 
of section 3 hold then part (2) of theorem ll.3l is satisfied. In section 5 we prove, for 
the 2-place case that if the condition does not hold then part (1) of the theorem is 
satisfied. In section 6 we prove the same for the n-place case. In section 2 we show 
that in the finite case we can not get a full understanding of Q^ similar to what 
we have in the countable case (not even for expressibility) . 
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1.2. Notations Conventions And Primary Definitions. 
Convention 1.4. 

(1) il is a class of finite universes, possibly with repetitions. So formally: il — 
{Ui : i € 3} for an index class 3 and we allow Ui = Uj for i j We will 
usually not be so formal and will write U € il and it should be understood 
as i e ? and U = Ui. We assume sup{\U\ : U G il} = Hq. 

(2) is a function on il and for all /7 G il, A[U] is a set of n-place relations on 
U (where n = n{^) is a natural number), closed under permutations of U. 
This means: if -Ri, i?2 C "C/ and (C/, i?i) « {U, R2) then i?i G ^[U] ^ R2 e 

(3) is a sequence of such functions. We write ^ ~ {Kq, ■■■,^ig(^)^i)- 

(4) $H is a function on il and for each [/ G il, $H[C/] is a n-place relation over U 
(where n = n(5H) is a natural number). 

(5) r is a n(9^)-place relation symbol. 

(6) For all [/ G il if S* is a n-place relation on U, and F is a m-place function 
on U, then s and / are a n-place relation symbol and a m-place function 
symbol respectively. We write {U, S) \= s{a) iff a G s, and {U, F) \= f(b) = c 
iff F{b) = c. (That is for all c G t/, a G "C/, 6 G '"C/). 

(7) For all U G il and n € u;, a G "U is a sequence of n elements in [/. We 
write: a — (ao, ...,a„„i), and lg{a,) — n. 

Definition 1.5. For all ^ as in II. 41 2 we define the second order quantifier Qsi to 
range over all relations in Formally we define the logic L{Qf^-^, Qa^) to be 
first order logic but we allow formulas of the form {Qiiir)ip{r) (r is a n(Ai)-place 
relation symbol) for all 1 < i < ?n. Satisfaction is defined only for models with 
universe ?7 G il as follows: \= {Q^ r)(p{r) iff there exists i?° G ^\U\ such that 
([/,i?0) h^(r-)- 

Definition 1.6. Wc say that ^ (or Q a) is definable in some logic £ iff there exists 
a formula ip{r) G £ (r is a n(.ft)-place relation symbol) such that for all [/ G il and 
R C "(■«)[/: 

{U, R) h <^(r) <^ Re Si[U] 
Notation 1.7. For 91 as in II. 41 4 we note Q<yi by Qa^^ where K ~ .^51 is defined by: 
R[U] := C : ([/,i?i) w (C/,9^[C/])} 

Definition 1.8. 

(1) We say that Qfi-^ is interpretable by Q^^ and write Q^Si < Qa2 if there ex- 
ist fc* G w and first order formulas: ipk(x,r) = ipk{xo, ■■■,Xn{jii)-i,ro, ...,rm~i) 
for k < k* (each r; is a n(.ft2)-place relation symbol) and the following holds: 

(*) For aU J7 G il and R G Ai[U] there exists k < k* and Rq, ...,i?,„_i G 
A2[U] such that {U, Rq, R,n-i) h (Vx)[i?(x) = Lpk{x,rQ, ...,rm-i)]- 

(2) We say that is expressible by Qfi^ and write <e3;p Qfi2 if there exist 

k* e Lu and formulas in the logic ^(QD^a): Vkix,f) = ipk{xo, a;„(j^j)_i, ro, r„i_i) 
for k < k* (each r; is a n(.R2)-place relation symbol) and (*) holds. 

(3) In (1) and (2) if fc* = 1 we write Q^^ <i-int and Q^^ <i-exp Qa^ 
respectively. 
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(4) We write Q^i =mt Q^a if Qui <int Qsi2 and . =exp is defined 
in the same way. 

(5) WedefineQj? <i„t {Q^^, J as in (1) only in (*) we allow i?o, S 
U'=o-*^[C^]- WewriteQ;jj= {gj?o,...,Qj?^^^_j_Jwlienl= (i?o, 

In the same way we define for <exp- 

(6) We define Q-^ <int if Q^^i <mt Q;^ for all i < lg{A^) again when 

= {^Q, ^-^^ In the same way we define for <exp- 

Lemma 1.9. 

(1) ^int o.nd <exp partial orders, Hence =int o.'^d =exp equivalence 
relations on the class of quantifiers of the form Qj^. 

(2) Q ^1 —int Q ^2 implies Q ^exp Q ^2 • 

Proof. Straight. □ 

So <exp gives a hierarchy on on logics of the form 2,{Q-^), i.e under the assump- 
tions of lemma lO^ the expressive power of Z'{Q-^) is at least as strong as that of 

Lemma 1.10. Let £ he some logic and assume are definable in £ (that is 

every A\ is, see definition M.b]) and Q-^ <exp then: 

(1) there exists a computable function that attach to every formula in 2,{Q-^) 
an equivalent formula in Z{Q-^). 

(2) the set of valid sentences in 2,{Q^) is recursive from the set of valid sen- 
tences in 2^{Q-^). 

Proof. Easy. □ 

1.3. Summation of Previous Results. We will use the following results. Proofs 
can be found in 

Definition 1.11. 

(1) let A be a function from il to N such that \[U] < \U\/2. Define il^J'"" by 
j^™°"[[7] ■.= {A(ZU : \A\ = X[U]}. We note Q^^o^ by Q^°". 

(2) For A as above define j^^^" by U{-^r°" ■ l^ < M- We note 



Q^^r by 



(3) For A as above define by ^]^^[U] -.^ {f : U ^ U : \Dom{f)\ = 
\[U], f onetoone}. We note Q^^i-i by Q\~^. 

(4) For A as above define J?<^^ by i^<^^[J7] := [ji^lT^ : M < A}. We note 

by Q]r,\ 

(5) Let A and /i be functions from il to N. Define A^^^ as follows: ^^^^[11] is 
the collection of all equivalence relations on subsets of U with exactly \[U] 



classes, and the size of each class is n[U]. We note (5j?j« by Q 



eq 



(6) Let A and ^ be as in 5. Define as follows: .^^''^ <^ is the collection 

of all equivalence relations on subsets of U with at mosl X[U] classes, and 
the size of each at most is ij,[U]. We note Qsi"^^ ^ by Q'^x <p- 



Remark 1.12. In 1 it is proved that g^°" =„u Q^?^" and QI~^ =m QI~^ 
will usually not distinguish between them. 
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Lemma 1.13. Let X be a function from ii to N, and £ a 2-place relation on il such 
that for all U E ii, 2;[C/] is an equivalence relation with at least X[U] classes each of 
which has at least X[U] elements (and possibly smaller classes). Then Q\^\ <i-int 
Qe- 

Proof, straight foreword. The interpreting formula is ip{x, y, so, sij S2) ■— so{x, y) A 
^si{x,y) A S2{x,y). (See P for similar proofs). □ 

Theorem 1.14. For every 9^ as in \1.4\ 4 there exists a function Xq ~ Ao(9^) from 
il to N such that: 

(1) Qao°" ^int Qm- 

(2) There exists with n = n{m) = and \Dom{^Ri[U])\ < Xo[U] + n 
for all U e il, such that =,nt {Q<y^^.Qx^}■ 

The interpretation is done uniformly, that is the formulas used are independent of 
91 (depend on n{y\) alone). 

Theorem 1.15. For each 91 there exists a function Ai = Ai(9l) from il to N such 
that uniformly: Qjh =int {Q^°^ ,Q]^^ iQ^nQe} , where n — n(9^) = '^(9li) and 
for all [/ e il, |Z?om(9li [[/])! < n ■ Xi[U] and €[?7] is an equivalence relation on U . 

Remark 1.16. In the proof of theorem II. 31 wc can assume without loss of generality 
that for all J7 £ il, |9t[?7]| < Xo\U] + n(9t), this is true since we can interpret 9li 
instead of 91 ('see ll.l4f) . Similarly using 1 1.1^ we can assume |9t[J7]| < Xi[U] ■ n{d\). 
Here we have an equivalence relation € that can change the bounds but the change 
will not be significant. Note also that Qj^^^ =int Ol^x^ (for all n S to). So in the 
simple case of the dichotomy (theorem 15.311 we prove Qjh ^mt {Q™°^^ ^Q]^^} but 
in the proof we will not pay attention to the size of the sets and functions we use. 

2. Limitations on The Classification of Qs^ in The Finite 

In this section we show that unlike the countable case in which we had an 
understanding of by equivalence relations, in the finite case there are classes of 
relations we can not express. 

Definition 2.1. For all n G w define J?„ by: ^[U] := {R : R C "L/} for aU U e ii. 
Observation 2.2. For all n G ut: Qa^^^ '^exp Qsi„- 

Proof. Suppose Qsi,^+l <exp Qfi„, and assume that the formulas used for expressing 
are ipk{x,rQ, ...,rmk-i) for k < k* . Note m = max{mk ■ k < k*} U {k*} and let 
[/ G il. Then by these formulas we can express at most • |.S„[J7]| different 
relation. Since |.^„[[/]| = 2l^l", if we choose U such that \U\ > \/log2(m?) we get 
|t/|"(|C/| - 1) > log2{m^), hence 2^ur(\u\--L) > and hence 2^'^^"^' > ■ 2l'^l". 
So the maximal number of different expressible relations is smaller than |.S„+i[?7]|, 
a contradiction. □ 

We have that for n > 2, Q^^ is not expressible by equivalence relations, unlike 
the countable case fsee ll.l|l . Moreover we have: 

Observation 2.3. For all n > 2: 

(1) Qa„ "^exp Q 

(2) Q^„ ^expQ''- 
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Proof. We prove (1). again suppose Qa^ <exp ^, and we use the notations of 
the previous proof. Note that = \U\l, and for \U\ large enough we have 

c is some constant. Moreover for all n > 2 and \U\ large 
enough we have \U\ ■ log{\U\) ■ c < |;7|". So we get: m ■ \K^-'^[U]\ < 2l'^l" which 
means the number of relations expressible is smaller than |.ft„[J7]|, a contradiction. 
The proof of (2) is similar using: i^^«[C/] < < 2\"\-iogi\u\)-c^ □ 

We get that in the finite case even for n{K) — 2, we can not express every Qj^ 
by 1-1 functions and equivalence relations. 

3. Primary Analyses 

Assumption 3.1. From here on, unless said otherwise, we assume that 9^ (see 
04) is fixed and A, = Xi{m) for i G {0, 1} f see ITTl and ITT^ . 

In this section we start the analyses of Q^. For each universe U we define 
a natural number k which is the maximal size, in some sense, of an equivalence 
relation on U interpretable by EH[J7]. The size of k is an indicator of the degree 
of "complexity" of 91. We will show that there is a dichotomy, ether d\ is very 
"complex" or it is "simple" . this is made precise below. 

Definition 3.2. Let r = {/o, /mj, sq, Smj, cq, Cmj} be a vocabulary, that 
is fi are n(/i)-place function symbols, Si are n(si)-place relation symbols and q are 
individual constants. Define: 

(1) for all [/ G 11 a model for r on C/ is M = ([/, f^^', fj^{ , 4^ s^^ , c*^ c^ij, 
where are n(/i)-place functions on U, sf'^ are n(si)-place relations on 

U and cf eU. U is called the universe of M and noted by \M\. 

(2) a model for t on 11 noted by 9Jt is a function from H such that for all ?7 G 11, 
Tl[U] is a model for r on U. Note that the function U ^ {U,d\[U]) is a 
model for {r} on H, we will not be as formal and say that is. 

(3) Assume r G r. We say that 971 expand (or is an expansion of) 91 if for all 
[/ G It, r^I^l ^9\[U]. More generally: 

(4) Let r C r' be dictionaries, and let and dJl' be models on 11 for r and r' 
respectively. We say that Tl' expand DJl if DJI'\t — dJl. That means for all 

[/ G H and fi G t, ff^ — /f^''^' , and similarly for relation symbols and 
constants. 

(5) We call r simple if: 

(a) T is finite. 

(b) For all i < mi, n{fi) = 1. 

(c) For all i < m2, n{si) = 1. 

(6) We cah M a SIMPLE model for t on U if: 

(a) T is simple. 

(b) M is a model for r on U. 

(c) For all i < mi, is a one to one function and |Z3oto(/*^)| < Ai[C/]. 

(d) For aU i < mj, |sf | < Xo[U]. 

(7) We call Tl a simple model for r on H if for aU [/ G H, Tl[U] is a simple 
model for r on U. 

(8) Let [/ G U and R a rt(9^)-place relation on U. We call M a simple expansion 
of i? on [/ for vocabulary r if: 

(a) r e T. 
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(b) M is a model for r on U . 

(c) r*^ = i?. 

(d) The restriction of M to r \ {r} is a simple model for r \ {r} on U . In 
particular r \ {r} is a simple vocabulary. 

(9) We call 9Jl a simple expansion of [H (on il) for vocabulary r, if for all 
[/ G il, S[)T[C/] is a simple expansion of y\,[U] for r on [/. 

Definition 3.3. Let r = {/o, /mn so; ■3^2; cq, c^a } be a vocabulary, and 
A a set of formulas in r. Let M be a model for r on J7, m G w, A C {7, and a G ™?7. 
Define: 

(1) The A-type of a over A in Af is: 

tpA{a,A,M) := {(^(5,6) : <^(5,t/) G A,lg{x) = m,,b € <'^A,M ^ <^(a,&)} 

(2) 5'X'(^,M) := {tpA(a,^,M) : a G "[/}. if M = ([/, i?) we write SX{A,R) 
instead and similarly in 1. 

(3) If p G S'^(^,M), ^ G "C/ and G p ^ Af h vif^'b), then we say 
that a' realizes p. in particular a realizes tp\{a, A, M). 

Definition 3.4. Let r — {/o, /mi, so, Sm2: co, Cma} be a vocabulary and A 
a set of formulas in r. 

(1) For all [/ G il, A C J7 and M a model for r on U, define an equivalence 
relation E = '^^ (we usually write E^^ '^^ where U is understood) on U 
by: 

E := {(x',x") G : tpA(a;',A,M) = tpA{x",A,M)} 

(2) Let t7 G il, TO G w and E an equivalence relation on U. We call i? TO-big, 
if E has at least to equivalence classes of size at least to. If i5 is not TO-big 
we say it is TO-small. 

(3) Let 971 be a model for r over on il, define a function from H to N, Aja = fcA,ajt 
as follows: fcA[t^] is the maximal number k such that there exists A QU^ 
\A\ < Xo[U], and is fc-big. 

Lemma 3.5. Let dJt be a simple expansion of for a vocabulary t, and A a finite 
set of formulas in r. then: {Q«.(3™j,°", Q^7^} >tnt Q'k^^^.^k^.m- 

Proof. For all C/ G il, let Au C [/ be the subset the existence of which is promised by 
13.41 3. Let s' be a 1-place relation symbol. Define a simple vocabulary t' :— tU{s'}, 
and a formula in r': 

^{x\x") := (V5) /\ {s'(6) -> [^(x'J) ^ (p(x",6)]} 

¥>(2;,|7)eA 

(where (V6) stands for Vbo...ybig(j,^_i, and s'(6) stands for Ai<ig(6)-i ^'(^i))- Let 
9Jl' be the simple expansion of SOt for r' defined by s'^ :— Ajj, for all [/ G il. 
Then for all f7 G il and a,b eU: 

Define <B by (£[[/] = E^^^^\ Since is a simple expansion of we have Qg <,;„t 
{QiR.Q^"", Qj^^^} (see II. 8f) when the interpreting formula is ^p. Now bv 11.131 we 
have Qe >int Q^k^ 

m,k/\ aji' transitivity of <int "we are done. □ 
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Lemma 3.6. Let n be a natural number no larger than n(y\). Let t be a simple 
vocabulary, and 371 a simple expansion of 91 for r U {r}. Let A be a finite set 
of formulas in t U {r}, of the form (p(x,y) such that lg{y) < n. Let U ii and 
k = fcA.a)i[C^]- Then there exists A'ZU such that: 

(1) \A\ <n(fc + l). 

(2) // Lp{x,y) e A and a £ ^s{v)u ^y-g ^ formula and parameters, then the 
formula ip{—,a) divides every equivalence class of E^'^^'^^ into two parts 
one of which has no more than (k + 1) ■ 2™ elements, where m* = | A| (fc + 

(3) There exists at least k+1 types, p G S^{A,VJl[U]), realized by at least fc-2'" 
elements of U each. 

Proof. Define a natural number mi by dawnword induction on / < fc + 1: m^+i — 0, 
mi — I A|(n(Z + 1))" + mj+i. By induction on ^ < fc + 1 we try to build a set Ai C U 
such that \Ai\ < n* I, and there exists at least / types p G S^{Al,^)Jl[U]) reahzed 
by at least (fc + 1) * 2™' elements each. If we succeed then the existence of Ak+i 
is a contradiction to the definition of k. (We assume here that < Ao[C/], 

but without loss of generality we can assume that as |j4fc+i| is bounded, see also 
remark fl.l6|l . Let Iq < k + 1 he such that we have built Aq, Ai^ but we can not 
build Aig+i. Put A^ Aig. Clearly A satisfies (1). We prove (2). 

Put M := 9}t[J7]. Let {Bi : i < Iq) be am enumeration of equivalence classes of 
E^'^ with at least (fc + 1) * 2™'o elements, (note that there are exactly Iq such 
classes since Iq is maximal). Let ip{x,y) G A and a g ^9(v)ij i-,g gome formula 
and parameters. The relation E^^j- divides every class Bi to at most 21^1**^1^1+"'^ 
parts. Hence by the pigeon hole principle at least one of those parts has at least 

2iA|.(^|+n)" > 2 l ^ l *'^'^''o+i))" — (fc + 1) * 2'"'o+i elements. If for some i there are more 
than one part with more than (fc + 1) * 2'"'f)+i elements then define Ai^^i — AUa 
and we get: 

(1) < \AiJ + \a\ <n*lo + n<n{lo + l). 

(2) There exists at least Iq + I types p G S^{Aif^+i,dJl[U]) realized by at least 
(k + 1) ■ 2™'o+i elements each. 

This is a contradiction to the maximallity of ^q. Now assume towards contradiction 
that ip{—,a) divides some i?i into two parts, both larger than (fc+l)*2™ (note that 
TO* > mig so there is no need to check classes smaller than (fc + 1) * 2™ ). Then 
Eaus divides each part into at most 2l^l*("('''+^))" classes and hence each part 

contains an equivalence class of Eaus with at least rJk\t{^*io+i))^ ^ 2i^"^i^(""(*o+i)')" ~ 
(fc + 1) * 2™'o+i elements, so Bi contains two such classes and this, as we saw, is a 
contradiction. To prove (3) we note that Iq + ^ < k + 1, and to* > to/q > to/q+i 
hence the existence of A;+ 1 classes with k*2™ elements contradicts the maximality 
of^o- □ 

Theorem 3.7. Let t be a .simple vocabulary, and A a finite set of formulas in 

T U {r}. Then one of the following conditions hold: 

(1) There exists a sequence of worlds: {Ui G il : i £ uj) , and a sequence of nat- 
ural numbers: {ui : i £ such that Ui > oo and there exists a simple 

vocabulary t' , a formula ip{x,y) in r' U {r} and a simple expansion 971' of 
91 for t' U {r}, such that for all i £ lu: {(x, y) £ '^Ui : M'[Ui] |= ip{x, y)} is 
an Hi-big equivalence relation on Ui. 
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(2) There exists a natural number k* such that for all U E il and M - a simple 
expansion of Ul[U] for t U {r} on U , there exist A — A^'^^ C U such 
that \A\ < k* , E^'^^ is k* -small, and for every formula Lp{x,y) G A and 
parameters a S ^s{v)u ^ (^(—^q) divides each equivalence class of E^'^^ into 
two parts one of which has less than k* elements. 

Proof. Define M to be the class of all simple expansions of for t U {r} on it. For 
all [/ e it define: 

k2'"''[U] = max{k^^^[U] : 971 £ M} 

Note that the definition of k^°'^\U] depends only on and not the over values 

of an (that is for each 971 G M) and since |{971[f/] : 971 G M}| < the maximum 
is obtained. Next we assume that sup{k^°-'-^[U] : U G il} = and show that 
condition (1) is satisfied. Let G il : i G lo) be a sequence of universes such that 
j^max\jjr^ — > CO, and for all i G w define = k^°-^[Ui\. Define a simple vocabulary 
r' — r U{s'} (s' a 1-place relation symbol). We now define 971. For alH G w note by 
Mi the model for TU{r} on [/, for which the maximum in the definition of k^°'^[Ui\ 
is obtained. Define 97t[C/i]|r U {r} := Mi. By 13.41 3 there exists a subset Ai C JJi 
such that E^'^^* is a n^-big equivalence relation on U. Let s'^I'^*! = Ai. That 
defines 971 (obviously the definition on universes not among the Ui is irrelevant). 
We define ip{x,y) to be the formula interpreting E^'^^' fsee l3.5f) namely: 

^{x,y) := (V5) /\ {s\b) -> [^(x,6) = i>{yM]} 

it is clear that condition (1) is satisfied. 

We now assume that {k'^°'^[U] : J7 G il} is bounded and let k by its bound, 
we show that condition (2) is satisfied. Let n := max{lg{y) : (p{x,y) G A}. We 
define k* = Max{(fc + 1) * 2l^l('=+i)"^'*"" , n(fc + 1)}. Now let U £ ii, and M a 
simple expansion of 9^[C/] on U for vocabulary r U {r}. Let A C U he the subset 
the existence of which is promised by the previous lemma. Then all the demands 
of (2) are clear from the previous claim and the fact k > fc^^°^[L/] > kA,<xii[U]. □ 

4. The Complicated Case of The Dichotomy 

In this section we assume that il and 9^ satisfy condition (1) in 13.71 that is we 
can uniformly interpret an arbitrarily large equivalence relation. We show that in 
this case we can interpret bounded number theory in the logic L(Q^). It follows 
that the set of logicly valid sentences in L{Q<}\) is not recursive. 

The following result is well known: 

Lemma 4.1. Let E be an n-big equivalence relation on a universe U. Then we 
can uniformly ( that is using formulas independent of U and E ) interpret the model 
({0, 1, n — 1}; 0, S", +, *) using a finite number of isomorphic copies of E. 

Corollary 4.2. In theorem \3.1\ if condition (1) is satisfied then we can uniformly 
interpret number theory bounded by Ui using a finite number of isomorphic copies 

ofRm. 



Proof Straight fromlO 



□ 



10 



SAHARON SHELAH^ AND MOR DORON 



5. The Simple Case of The Dichotomy 

In this section we will interpret Qm when £H is "simple" that is when condition 
(1) in theorem 13.71 is not satisfied. We will show that in this case there exists a 
simple model on il in which it is possible to interpret IK by a first order formula. 
In fact we prove QfR <int {QaJ,°"i Q]^^} so we get a full understanding of QfR. 

5.1. Formalizing The Assumptions And The Main Theorem. 

Assumption 5.1. In this section we assume that il and do not satisfy condition 
(1) in theorem 13. 71 (Note that this condition is independent of A). Hence from that 
theorem we get the following: 

(1) For every simple vocabulary r, and A a finite set of formulas in rU{r}, there 
exists a number fcj — fci(A) and a function that assigns to every U £ ii 
and M - a simple expansion of Dl[U] for r U {r} on U, a set A = A^'^^ C U 
such that condition (2) in theorem 13.71 is satisfied, that is: 

(*) 1^1 < E^'^ is fc^sma^, and for every formula ip{x,y) £ A and 
parameters a £ ^a^v^U , (p{—,a) divides each equivalence class of E^'^ 
into two parts one of which has at most elements. 

(2) For every simple vocabulary t, and every formula ip{x,y) in r U {r}, there 
exists a natural number k2 — k2{ip) such that: 

(**) If 971 is a simple expansion of U\ for r U {r} and U £ il, then the 
interpretation of (p{x,y) in M[U] (that is {(x^y) £ : Tl[U] \= 
(p{x,y)}) is NOT a fc2"big equivalence relation. 

Remark 5.2. We can increase ^^(A), meaning if m > fc^(A) than m satisfies (*) 
(for the same function A'^''^). Hence: 

(1) If we are given a function A t— > m(A) then without loss of generality (by 
changing the definition of fcj) we may assume: fci(A) > m(A) for all A. 

(2) If A C A' then without loss of generality (by redefining fc* by induction on 
A|) we may assume kl{A') > fc*(A). 

We now formalize the main theorem of this section. 

Theorem 5.3. There exists a simple vocabulary t, and a first order formula 
ip{xQ, Xn{<}i)-i) i"^ 'T 1 o,nd there exists dJl a simple expansion o/ *H for r U {r} 
on il such that for all U £ il: 

m[u] h {yx)[r{x) = ip{x)] 

Corollary 5.4. g„ <,„t {Ql^^QZ"}- 

Proof. Straight from the theorem when the interpreting formula is ip. □ 
In the rest of the paper we will prove theorem 15. 31 

5.2. Proof of The Main Theorem in The 2-place Case. We prove theorem 
15 .31 under the assumption n(£H) = 2. A will be a finite set of formulas with at most 
2 free variables in the vocabulary {r}. In other words t = 0. Hence the set ^[/'*^ 
fsee l5.1f) and the relation E^''^'^ fsee l3.4|l are independent of A/, and depend on A 
alone so they will by noted by A^ and E^. 

Definition 5.5. Let A be as above and [/ G il. Let k* = fc^(A) and A = A^ be 
the ones we get from 15 .11 1. We define: 
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(1) For all ip{x, y) £ A and yo £ U: 

MinorityAiuo, (p) := {xq e U : \{x e U : xE^xq A (p{x,yo) = ip{xo,yo)}\ < k*} 

(2) S — S"^ is the 2-place relation on U given by: 

xo^yo^a^oe IJ MinorityA{yQ,f) 

ip{x,y)eA 

Lemma 5.6. Let A be as above. We use the notations of the previous definition 
and also note ^2 = k2{ip) (see \5.1\ 2) where tp{x',x") :— i^b) /\^i^,^-^^^{s(b) 

[ipix',b) = ip{x",b)]}- Then: 

(1) |{a; : \x/E^\ <2-k*}\<k* .2l^l'=*+i, and we write I* = k* ■ 2l^l'='+i. 

(2) For all y G U: \{x : xSy}\ < |A| • {k*f + I*. 

(3) |{a; : \{y : xSy}\ > 2l^l('=*+'=2) • /fc* + T } | < |A| • (/c* • /c*)2 . 2l^l('^'+'^2') + P . 

Proof. (1): The number of types p G S^{A, 5H[C/]) is no larger than 2l'^ll'^l since for 
every formula in A there are at most two free variables. We also have |^| < k*. 
So the number of equivalence classes of is no larger than 21^''^ and (1) follows 
directly. 

(2) : Let x,y e U. Assume \x/E^\ > 2 ■ k*. For all ip e A we have x/E^ n 
Minority /s,{y,ip) < k* . Hence \{x' : xE^x' Ax'S^y}\ < |A| • k* . The number of 
equivalence classes of E^ which are larger than 2 ■ k* is also no larger than k* . 
Hence we get: \{x : \x/E^\ > 2 ■ k* AxS^y}\ < |A| • (fc*)^. To this we add at most 
I* elements from "small classes" (see (1)) and (2) follows. 

(3) : We write to = |A| • (/cj ■k*)'^ . 2l^l('=*+'=2). First we disregard aU the elements 
of {x : \x/Ea\ < 2 • k*} and using (1) we decrease the bounds by I*. So seeking a 
contradiction we assume that there are different [xq, Xm} so that for each i < m 
there exists different {y^, y^^i^nk* +k^) with XiSy^ Using (2) (with the bounds 

in (2) also decreased by 1*) there exists a subset of {xo,...,a:m} with at least /cj 
elements such that the elements of 1^. :— {y* : XiSy'^} are pairwise disjoint (see 
figure). Without loss of generahty we assume that this set is {xq, ...,Xk^}. For 
every Xi the sets of 1^. satisfy at most 2l^l('^ +'^2) different types p € S^{A U {xi : 
i ^ ^2}i^[^])- Hence there are more than of them that satisfy the same type 
(again we assume those are the first elements). In conclusion we get {xi}^!^ and 
{yj}i,j=o,...,k* without repetitions such that the type tp^iyj, Au{xi : i < fc^}, 9^[C/]) 
is independent of j, and Xi-^SyJ' 4^ ii = i2 holds for all Ji,«2,i < ^2- So V' with s 
taken to represent A U {xi : i < /cj} interprets a fc^-big equivalence relation on U. 
This is a contradiction to the definition of fc2. □ 
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Lemma 5.7. There exist a simple vocabulary t, and a finite set of formulas <i> in 
T, and a simple model 971 for r on il, such that for all U E ii and x, x' , y,y' E U if 
tp^iix,y),(l},m[U]) ^ tp^iix' ,y'),9,m[U]) then {U,m[U]) ^ r{x,y) = r{x' ,y'). 

Proof. We simultanios define t and its interpretation Tl[U] for some [/ S 11. <i> will 
be the set of atomic formulas in r with terms of the form x, /(x), c, /(c) (function 
composition is not allowed), for gravity we write: M := Tl[U] and R :— d\[U]. Let 
A := {r{x,y)}. Using the notations of 15. 61 we define: 

A* ^AU{x: \x/E^\ <2-k*}u{x: \ {y : xS'^y}] >2\^\ik'+K) .fc*+r} 

by 15.61 1^*1 is uniformly bounded (that is the bound is independent oi U). t will 
contain: private constants for all the elements of A*{{cx ■ x € A*}, c*^ :— x), 
and 1-place relation symbols for the equivalence classes of E^, ({s^/£;a^ : x £ U}, 
^x'^fE^ ''~ ^/^A')- Note that the number of such classes is also uniformly bounded. 
Now We look at S^\U\A* this is a digraph with (uniformly) bounded degree, that 
is for aWx eU\ A\ \{y ^ A* : xS'^y}] is bounded by 2l^l('='+'=2) ■ + I* and 
for ally e U\ A*, \{x i A* : xS^y}\ is bounded by |A| * {k*f + I* (seeESJ. 
Hence we can divide S^\U\A* into {S,n : m < m*) with: Um<m- S^ = S^\U\A* 
and for all m < to*, Sm is a digraph with degree 1, that is a one to one partial 
function on U\A* . Note that m* is uniformly bounded, in fact it is bounded by the 
sum of the two bounds mentioned above. We add to r, 1-place function symbols 
{fm : TO < TO*} and define f^ := S„,. 

Let {Bi : i < i*) be an enumeration of {x/E^ \ A* : \x/E^\ > 2 • k*}. Note 
that i* < k* . For all y £ U and i < i* there is a truth value t^ that is the value 
the formula r{—,y) gets for the majority of the elements of Bi. Since we deal 
with "big" classes (that is with more than 2 ■ k* elements) we get: for all y £ U, 
i < i* and x e Bi, R{x,y) = t\ <^ ^xS^y. We divide each Bi into 2*' parts 
according to the truth values, tf : i < i* . This means that for each part, the value 
of the vector {t\ : i < i*) is independent of y. For all i < i* , we note these parts 
by (Bj : j < 2* ). We add to r, 1-place relations {si,j : i < i*,j < 2^ } and define 

^Tf^^ ■— ^j- This completes the definition of r and 971. 

We now prove that 9H is as desired. Let a, a', 6, 6' G J7 and assume ip$((a, 6), 0, 9Jl[C/]) = 
tp<s>{{a' ,b'),9,Tl[U]). If a e A* then a = a' (due to the formula x = Cx), and the 
truth value of R{a,b) is determined by b/E^,. Moreover b/E^, = b' / E^, (due to 
the formula Sj/^a^(?/)), so we get R{a,b) = R{a',b') as desired. Symmetricly we 
deal with the cases b, b'a' £ A* . So we can assume a, a', b, b' ^ A*. By the definition 
of the functions Sm we have: 

aS^b ^^=> (3m < m*)aSmb 

a'SH' <^ (3m < m*)a'Smb' 

But due to the formulas of the form fm{x) = y, the right hand side of both 
equations is equivalent, so we have aS^b -i^ a'S^b'. Assume a G B^^, b G Bj\ Due 
to the formula Sij{x) we get a' S B^^, b' G B^^. By the construction of the Bf we 
get: 

R{a, b) = t\^ ^ ^aSH 
R{a',b')^tl <^ ^a'SH' 

But 6,6' G S'^ so tf, = i-', and as we have seen a5A6 <i=> a'S^b'. Hence 
R{a, 6) — R[a' , 6') as desired. □ 



A DICHOTOMY IN CLASSIFYING QUANTIFIERS FOR FINITE MODELS 



13 



Corollary 5.8. Theorem \5.,y\ is true for the case n($H) = 2. 

Proof. Let r, $ and VJl be as in the previous claim. Note that by the definition of <i> 
all the formulas in <!> have at most 2 free variables. Define C = {t\t : $ {T,F}} 
(each member of C represents a type in 5*1(0, 9Jl[t/])). For all D C C define: 

XD{x,y) -.^ y [ /\ ^(x,y)iW')] 
teD 4)(x,y)e<^ 

where 'ip"^ = tp^ ip^ = -ntp and X(/}{Xiy) ■— x ^ x. (The formula XD{x,y) means 
{x, y) satisfies one of the types in D). For all [/ G il define Du C C by: 

{teC\{3x,yeU)[{U,nU])^r{x,y)A{{U,m[U])^ /\ i;{x,yy-(^^)]} 

This means Du is the collection of types tp^{{x, y), 0, OJl[C/]) such that ([/, *H[J7]) \= 
r{x, y). Using the previous claim it is easy to verify that for all J7 G il and x,y G U 
we have: 

([/, m[U]) h r{x, y) ^ [U, m[U]) h XDu {x, y) 
We now add to r constants: {ctrue] U {cd : D C C). For each [/ G il, ctme is 
interpreted in 9Jl[?7] by some element of U. The rest of the constants are interpreted 

so that for all D C C: (c^'*^' = c^i^') -^=> (D = Du) holds, (assuming U has more 
than one element there is no problem to do that). Now the desired formula in 
theorem 15. 31 is: 

f{x,y) ■■= /\ [(cD = Ctrue) XD{x,y)] 
DCC 

a 

6. Proof of The Main Theorem in The General Case 

We prove theorem 15 . 31 when n(J)\) > 2. from here on we assume: 

Assumption 6.1. r is a simple vocabulary. A is a finite set of formulas in tU {r}, 
such that f{x) E A — > lg{x) < n{9\). 

First we generalize definition 15.51 

Definition 6.2. Let r, A be as above. Let U G ii and M be a simple expansion 
of m[U] on [/ for T U {r}. Let n < n{9l). We note k* = kl{A) and A = A^'*^ the 
existence of which follows from 15. il l and define: 

(1) For aU ^(x,y) £ A with Igijj) n and h G "[/: 

MinorityA.Aiib, f) := {x E U : \{x' G U : xE^"^^ x' A if{x,h) = (y9(x',5)}| < k*} 

(2) Define a relation S'X^m x "[/: 

A'S'a^a/^ <J=^ a G (J{Mmoritj/A,Af(6, : v{x,y) G A, ^^(y) = n} 

Remark 6.3. For i G {1, 2} assume r^, A^ satisfv IfTTl and 971^ is a simple expansion 
of 9^ on il for riU{r}. Furthermore assume ti C t^, Ai C A2 and Tli — OT2IT1. By 
15.21 2 we may assume fcJ'(A2) > /ej['(Ai), hence for all i7 G il we can assume without 
loss of generality (we can add elements to if needed) that a,S^^ gj,^ b =4> 

Lemma 6.4. Using the notations of the previous definition: 
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(1) \[x : \x/E^'''\ <2-k*}\<k*- 2l^lU;,)+i. 

(2) Forallbe^U: \{x e U : xSlj,jb} \ < |A| • (fc*) V fc* • 2l'^l("(»»)+\ 

(3) We write: I* = I* (A) := |A| ■ {k*f + k* ■ 2^^\i^m)+\ 

Proof. Similar to the proof of 15.61 only in (1) we have at most different 
choices of parameters for each formula. □ 

Lemma 6.5. Symmetry Lemma (with Parameters): 

Assume r, A satisfy JKT\ and Let ^ be a simple expansion of d\ for t U {r}. 
Let n < 7i(9^). Then there exists a simple vocabulary r' D t, and W a simple 
expansion of DJl for r' U {r}, and for i € {1, 2} there exists Ai — Aj(A) such that 
t', Ai also satisfy JK7\ and for all U ^ ii, a,b and c £ "^^J7; 

Proof. First we define a few constants we will use later: 

m* :— k2{4>) (see assumption I5.1|l . where is the following formula in r U 
{s,ci, ...,c„„i} U {r}: 

= 0(y,2/') := (Va;) /\ {s(x) [■0(a;,y,ci, ...,c„_i) = -0(a;,y',ci, ...,c„ 

i/>(a;,j/,zi,...,2„-i)eA 

(s is a 1-place relation symbol and ci,...,c„_i are constants not in t). We also 
define: mi = mi(A) := {m*f ■ 2l'^l"* • r{A) and toj = m2(A) := m* ■ 2l^l"'*, 
where Z*(A) was defined in the previous lemma. 

let S[)T',r' and ^j{x,x') be the vocabulary, model and formula which interpret 
E^'^ (see the proof of 13.5|l . We define in r' a formula that will interpret xS'^ ot[(7]2/^ 
in ait'[C/] (where lg{z) = n - 1): 

X(a;,y,z):= ^ (3^'=^(^)a;')[i^(2;, 2:') A (</?(2:, 2) = (^(x', y, z))] 

We therefor get: 

(*) for al\U Czii, a,b eU and c € ""if/: Srn'[t/] h x{a,b,c) aS'X^OTlc/j^c 
Define: 

X'(x,z) := (3>"^y)x(a;,y,z) 
Ai := AU{x'(a;,z)} 
A2 := A\j{x{x,y,z)] 
Note that bv 15.21 1 we may assume that kl{A) > TOaa:{TOi(A), r7i2(A)}, and by 
15.21 2 we may assume kl{Ai) > kl(A) > mi{A) for i € {1,2}. We now assume 
towards contradiction that there exists U € ii, a,b € U and c G "^^C/ such that: 

(1) a^2,OT[c/]&c. 

(2) -iaSl:!m'[uf)- 

(3) -^ibSl^^^,^,j^ac). 

From (3) and fci(A2) > m2 we can find [bo, without repetitions such that 

for all i < m2. Tl'[U] x(^, c) = x(a, ^i, c). from (1) and (*) we get that for all 

1 < m2: M'[U] \= x{a,bi,c). Hence m'[U] \= x'ia,c). from (2) and fc*(Ai) > mi 
we can find {ao, a,„j} without repetitions such that for all i < mi: *H[J7] |= 
x'(a, c) = x'(ai;C). We have seen that OJl'[C/] 1= x'(aic) so by the definition of 
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x'{x,z) we have for all i < mi, there exists {bo, ■■■,bl^^} without repetitions such 
that i < mi Aj < 1712 => gji[[/]^}c. By the definition of Z*(A) and a repeated 
use of the pigeon hole principle we can find a subset of [gq, ami}, {'^io^ ^im* } 
such that the sets {{^0 ' ''ma) • ^ — ^"^^ pairwise disjoint, without loss 

of generality we assume ii = I for all I < m*. Using the pigeon hole principle 
again we can find for all i < m* subset of {6q, ...,6^^} with m* + 1 elements (and 
again we assume this subset is {6q, }) such that for all ip{x,y,z) G A and 

ji,j2 < m* we ha.ve ip{ai,b^j^,c) ^ i/?(ai, 6*^, c). In conclusion we got: {ao, ...,am*} 
without repetitions and for each i < m*: {5q, } without repetitions such 

that ai^S'^byc <^=> ii = Z2. Moreover the elements of {6q, satisfy the same 

formulas of the form ip{ai,y,c) G A (c and ai arc parameters). Now the formula 
(j)[y,y') (where s is taken to mean {oo, ...,am*} and the constants Ci are taken to 
mean the elements Ci) interprets a m* + 1-big equivalence relation on {t/*- : i,j < 
m*}. This is a contradiction to the definition of to*. □ 

We now prove a number of lemmas we need for the proof of the main theorem. 
First we show that we can code a delta system of n-tuples by singletons: 

Lemma 6.6. Let n be a natural number. Then there exists a simple vocabulary t, 

and a formula 6{x, y) in t with lg{y) = n such that: for allU G ii and delta system 

(a} G "?7 : i < i*^ (i* some natural number), we have a simple model M for r on 
U and a sequence {bi € U : i < i*) such that: 

(Va G "J7)(V6 G U)[M h Oib. a)] iff {3i < i*)(b = b^ A a = ^)] 

Proof. Define r = {cq, c* , Ci, c„, Sq, Si, /i, /„}. For each n > t > define 
the formulas: 

Ot{x, y) := yo = Co A ... A yt = c* A yt+\ = xA yt+2 = ft+2{x) A ... Ay„ = fn{x) 
0{x,y) := si{x) A /\ [so(c*) ^ ^t(x, y)] 

n>t>0 

Now let U G il and assume ^a' G : i < i*^ is a delta system, this means we 

have some n > t* > 0, such that: |{aj : i < i*}\ = 1 for all 1 < t < t*, and 

\{al : i < i*}\ = i* for all n >t > t*. We can now define M : 

Cq ...c* are some distinct elements of U (we assume \U\ > n). 

cf^ = a\ (for 1 < t < t* and assuming t* > Q over-wise the definition of is 

insignificant). 

s-:={cf}. 

8^ := {aj.+i : i <i*} (assuming t* < n over- wise define to be some singleton). 

f^ := {{al,_^_i,al) : i < i*} (for t* + 1 < t < n and assuming t* + 1 < n over-wise 
the definition of f^^ is insignificant). 

Note that f^ are one to one functions in the relevant cases. In conclusion we define 
(bi = : i < i*) (again we assume t* < n over-wise we define {bi G U : i < i*) 

to be some constant sequence). So by our definitions we get M \= Of {bi, a*) for all 
i < i*. Moreover if M ^ 9t*{b,a) then there exists i < i* such that b = bt and 
a = a\ Hence 6, M and {bt : i < i*) are as needed. □ 



We now show that it is impossible to interpret large order relation on H. 
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Lemma 6.7. Let tq be a simple vocabulary, and ip{x, y) a formula in tq U {r} (not 
assuming lg{x) = Igiy) )■ Then there exists a natural number k* — — k^(ip) such 
that for every 9JI a simple expansion of 91 for Tq U {r}, and for all U € ii, it is 
impossible to find sequences (jii g ^9(^)1/ ■ j < /j*^ ^jr^j^ ^j,^. g ig{'y)u ■ j < /j*^ such 
that: 

Proof. Let (f{x, y) and tq be as described. For i G {1, 2} let Ti,Oi be the vocabulary 
and formula used to code delta systems for n = lg(x) and n = lg(y) respectively 
(i.e. those from the previous lemma). Add to tq new 1-place relation symbol and 
function symbol, s* , /* . In the vocabulary r — roUriUT2U{s*,/*}U{r} (without 
loss of generality the unions are disjoint) define the formula: 

cp{v,v') {^^ii)s*{u) A (Va;,^,y,7){[ei(?VE) A (e,(r(u)^) 
hO^iv.y) A e2[v' ,']/)] [ip{x,y) = ip{x,l/) A ip(x^ ,y) = -(^(F,7)]} 

which will interpret a large equivalence relation. For all m,n €z lu Let Delta{n, m) 
note the minimal number d such that every sequence of d n-tuples has a subsequence 
of length m which is a delta system. We can now define k^{ip): 

k* = k^{ip) := Delta{lg{x),Delta{lg{y),{k^{(j))Y)) 

Seeking contradiction we assume that there exist 9Jlo a model for tq on il, 
?7 G it and sequences as in the lemma. By the definition of k* there exist sub- 
sequences of length (^2(1/1))^, which are delta systems. Note ^2 := k2{4')- without 
loss of generality we assume these subsequences are: (al S 's(^){7 : i < (fc2)^) and 
(6~ e ^a(y)u : j < {k2f). Let Mi,M2, (a, e ?7 : i < {k^f) and (6^- e U : j < {k2)^) 
be the models and sequences used to code (oi : i < (^2)^) and (6j : j < (^2)^) (see 
16.6(1 . We define M a model for t on U: 
For each i e {0, 1, 2}: M\n := M^. 
s*" := {flj.fe, : j e {0, 1, 2, k2 - 1}}. 

/* ■= {{<^j-k2i <^{{3 + l)mod(k2y)-k2) ■ j £ {0: 2, ^2 - !}}• 

Note that if tt is the permutation of {oTk G ^9{x)jj . j ^ ^^j defined by 77(0^.^2) = 
a((j+i)morf(fe2))-fc2' then the formula: 

'l>'{y,y') ■■= (-'3x e {071:7 e: j < fc2})[(p(x,f) = ip{x,y') Aip{TT{x),y) A -.(^(7r(5), y')] 

interprets in M a fc2-big equivalence relation on {bj : j < (fc2)^} namely the relation 
{(bi^bj) : i, j e (^2)^, 3/ e {0, A:2 - 1} s.t.ij e [1,1 + 1, ...,l + k2)} . Hence by the 
properties of 0i and 02, the formula (j){v, v') interprets a fc2-big equivalence relation 
on {bj : j < (^2)^} which is a contradiction. □ 

we need one more lemma before we can prove the main theorem. 

Lemma 6.8. Let t be a simple vocabulary and >f{x, y, z) a formula in t Ur. Then 
there exist a natural number fc* = = kl{ip) such that for every 3Jl a simple 
expansion of9\forTU{r} onii and for allU G il, it is impossible to find: c' G ^9(.^)iJ 
for each I < k* and sequences (a\ d U : i < fc*) and (Uj £ U : j < fc*) such that: 

(a) For all l,i,j < k* , m[U] h '^(ai,6j-,?) iffi^h 

{(3) For all li < I < k* , the truth value of Lp{a\^ ,b^j ,d) in 9Jl[?7] is independent 
ofij < k*. 
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Proof. Note lg{z) — n. Let r' and 6{x, y) be the vocabulary and formula we get by 
applying lemma IfTfil to n. Define a simple vocabulary r* := r U r' U {si, S2, /}, and 
formulas in r*: 

V'i(2:,y) si{x) As2{y) A (Vz)[6'(2/, z) ^ (p{x, f{x), z)] 

Mx,x') ■.^s,ix)Asi{x')A{yyyz)is2iy)A0{y,z)) ^ [(^(a;, (/(a;), z) = /(x'), z)] 

Put k* Max{k^{'ipi),k2{ip2)} + 1- Let U e U. and M some simple expansion 
of 9l[U] for r U {r}. seeking contradiction assume that for all I < k* there exist 
(J. g ia(i)jj and sequences (al e U : i < k*) and (5^ e U : j < k*) satisfying (a) and 

(/3). By increasing k* to Delta{n,k*) we may assume that {^c' :Z < fc*^ is a delta 

system. Hence the truth value of the sentences a[j = and (p(a[^ , 5'^ , c') depends 
only on the order type of the indexes (again by increasing k* and using Ramsey 
theorem). Moreover without loss of generality we may assume that: a[j^ = =^ 
(^1 = A (ii = 12). This is true because we can increase k* to (fc*)^ + 1 and 
choose the sub sequence (^a\ : k* ■ I < i < k* ■ {I + ^ I) (as (^a\: i < k*)). Now 
if — a/ then by our assumption we have = a!^ or a!^ = a!^, hence 

we get cLil^i = a-il or a-^^_^ = a^^ contradicting (a). Using the same argument 
we may assume that = 6'^ ^ (Zi = I2) A (ii = ^2). Now using {(3) exactly 
one of the following conditions hold: ever li < I < k* ^ AI ^ ip{a\^ ,b''j- ,d-) or 
Zi < Z < fc* A/ 1= -^ip{a\^ , 6^-^ , c'). We will deal with the first case (the second can 
be dealt with similarly). We have three cases: 

(1) There exist i* ^ j* < k* such that for all Z < Zi < Zc* we have: M \= 
-^(a[i,6;.l,?). 

(2) There exists tt a permutation of {0, ...k* — 1} without fixed points so that 
for all I < li < k* and for all j < k* we have: M \= ip{aj^ ,b'^^jyd). 

(3) Never (1) nor (2) hold. 

As stated above r' and 6{x,y) are the vocabulary and formula we get by applying 
lemma to n. Let M' and id' ^ U : I < k*) be the model and sequence we get 

by applying that lemma (in U) to ^c' :Z < k*^. For each of the cases (l)-(3) we 

define M* a simple expansion of M for t* U {r} and get a contradiction. In each 
case M*\t' := M' . The interpretation of si,S2 and / will be given for each case 
separately: 

Case (1): Define sf := {c' : Z < Zc*}, := {a\. : I < k*} and /*^* := 

{(a^.,6j. : Z < Zc*}. Then we have I > ^ M* \= (p(a-i , /(a[i),?) and hence 
the formula tlji{x,x') interprets in M* an order relation (in the sense of lt).7|l on 
{c' : Z < Zc*} X {a{. : I < k*}. This is a contradiction as Zc* is larger than Zc3('0i). 

Case (2) Define sf := {c' : Z < Zc*}, sf* := {a\ : i,l < Zc*}_and /^* := 
{(^IKii) ■ < k*}. Then we have I ^ h ^ M* |= (^(a[\ /(a[^),?) and hence 
the formula ip2ix,x') interprets in M* the relation {(a'j^,a'^) : Zi = Z2 A ji,?2 < fc*} 
which is Zc*-big. This is a contradiction as k* is larger than Zc2(V'2)- 

Case (3): In this case we assume that (in advance) we chose (fc* + 2) • Zc* instead 
of Zc*. (So in cases (1) and (2) it is enough to find subsets of size Zc* with the desired 
properties). Look at (^0^'-+'^')''^ : Z < Ze*), and the sequences (aj['j^? ^ '■ j < k*\ and 
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(b^jX*^ ^ : j < fc*^ for Z < fc*. Since (1) does not hold for these sequences we get 

(choosing j* = and j* = 1) that there exist 1* < /* such that ip{aQ^^^''''' , , c(''+2)''=* 

In the same way (choosing i* — 1 and j* = 0) we get that there exist I** < Z** 
such that (/7(a^r+^^'''*,6^'**"^^^'''*,c'"). Now look at {c^^'+i . / < fc*^ and the se- 
quences ^flj'"'^' ■ j < k*'j and (^6^'''+' : j < fc*^ for I < k* . Let tt be a permutation 

of {0, k* — 1} without a fixed point. We show that these sequences along with 
TT, satisfy the demands of case (2). Let j < k* and I < li < k* . If j < Tr(j) 
then j < TT{j) < 2k* +1 < 2k* + h and < fc* < (Z* + 2) ■ A:* < {l^ + 2) • k*. 
Since the truth value of ip depends only on the order type of the indexes we get 
^(af , b%^'^ , c^'^'+O (as ^(4'^+')-'=* , l/i!^'^-'' , c('*+2)-r )). k ^(,) < , get 
the same result, only now we use the 4-tuple < fc* < (/** +2) ■ k* < {l^* +2) ■ k*. 
In both cases we have ^(flj" c^'^ as needed in (2). So case (3) can 

not hold. □ 

We are now ready to prove theorem 15. 31 in the general case. We prove: 

Theorem 6.9. Let 9^ be as in \1.4\ 4 i^at satisfies \5.1[ Then there exist a simple 
vocabulary a, f{x) a formula in a with lg{x) = n{^), and a simple model for a 
on it. Such that for all U E ii and a G "(^)[/; 

^[U]\=ipia)^{U,m[U])^r{a) 

Proof. We prove the theorem by induction on n(9^). The cases n(5H) — and 
rt(9^) — 1 are trivial, the case nidi) = 2 was proved in l5.8l 

Before we turn to the proof of the induction step we pay attention to the following 
fact. Let 91' be as in 11.41 4. We say that "DV is definable from 9^ by a simple 
expansion" if there exist a simple vocabulary t, a simple expansion 9Jt of 9^ for 
T U {r} and a formula ip{xQ, ■■■,Xn{m')-i) in r U {r} such that for all J7 S il and 
a e "(«')[/ we have 9^'[f7](a) iflF m[U] h ^(a)- Note that if 9^' is definable from 
9^ by a simple expansion then 9^' also satisfies assumption 15.11 (or else 9^ does 
not satisfy the assumption for we can define a big equivalence relation from 9^ 
using ip and the model 9Tt). If 9^' is definable from 9^ by a simple expansion and 
n(9^') < n(9^) then by the induction hypothesis there exist: ctq a simple vocabulary, 
ipo{x) a formula in ctq with g{x) = n(9^'), and *Tto a simple model for uo on il. Such 
that for aU [/ e il and a e "(3^')[/: 

mo[C/] hV'o(a) <=^9^'[f/](a) 

in that case we will say that 9^' satisfies the induction hypothesis and that ctq , ipo 
and OTo interprets it. 

We now assume n(?l) = n+1 > 2. We prove this case in two stages. In the first 
stage we show that we can interpret the relation xS^, fjyiV, so we prove: 

Lemma 6.10. Let A,r satisfy assumvtion \6.1V and let dJl be a simple expansion 
of 9^ for T U {r} on iX. Then there exist: 

• A simple vocabulary do (r <^ oq). 

• ipo{x,y) a formula in ctq (lg{y) = n). 

• 9^0 a simple model for (Tq on il. 

Such that for all U E ii, a E U and b e "[/ we have: Vto[U] |= (pQ{a,b) 
""^A,<m[uf- 
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Proof, (oi lcmma l6.1()|l . Let TI*,t*, ip{x,x') and xi^iVi^) (where lg{z) = n — 1) be 
the vocabulary, model and formulas interpreting E'^''^^^^ and 5*2 ^[t/] that were 
defined in the proof of the symmetry lemma (noted there by Tl' , t'). We also define 
a formula that will interpret an order relation in dJl* : 

= <l>{x,y) := [x{xo,Xi,y) = xix2,X3,y)] 

where lg{x) = 4 and lg{y) — n—1. In the vocabulary t* we define a set of formulas: 
A* := A U {x,?!)}. For gravity we write M m[U], M* m*[U], Nq := mo[U] 
and similarly for other models, where ?7 € iX is understood from the context. Next 
we define some constants that we will use in the proof: 

(1) nil :— mi(A) :— Max{k^{(t)), kl{x)} + l for the formulas x, (j) defined above 
fseelOand O|) . 

(2) 1712 '■— m2(A) :— (toi)^ + mi. 

(3) For all ?7 G il choose by induction on m2 > I, Ai — C U such that: 

(a) Ao = 0. 

(b) Ai C Ai+i for aU I < m2. 

(c) For all I < ni2, r < n + 2 ■ mi and a type p G S'^,{Ai,dJl*[U]): if p is 
realized in 9Jt*[J7] then it is realized already in Ai+i. 

(d) For all I < m2, is minimal under the properties (a)-(c). 

(4) We write A* = A*" = A^^. 

(5) Note that under these conditions there exists a bound on \A*\ depending 
only on |A*|, mi, r7i2 and n, so in fact the bound depends only on n and |A| 
and we can calculate it in the beginning of the proof. We note this bound 
by m^. We do not calculate the value of but note that it increases 
super-exponentially as a function of |A|. 

(6) TO4 :=TO4(A) := /*(Ai(A)) +r(A2(A)) -TOi. (see El and El . 

(7) TO5 TO5(A) = 2 • TO4 + ma + n + 2. 

Note by S = vp; the n + 1-place relation on il defined by &[U] :— {{x, y, z) G 
"+-^J7 : xS^fjjj^^jjT^yz}. (We keep using the existing notation and write x&\U]yz 
instead of &\U]{x,y,z), or sometimes write xS^^ rjy^^jj^yz as before). Our aim is 
to interpret the relation 6 by a formula in a simple model on il. First note 
the following fact: Assume there exists a number i* such that for all C/ G il: 
"+^[/ = lJi<i* ■ Assume farther that for all i < i* the relation 6^ defined 
by 6i[C/] :— &[U] n is interpreted by the formula (pi and the simple model 
for the vocabulary ai. Then the formula Vj<i* Vi{x,y,z) in the vocabulary 
Ui<i' and the model 01 defined by (Vi < i*)9T|cri — 01^ will interpret S as 
needed. We return to the proof of the lemma. Let (pi : i < i*) be an enumer- 
ation of all the A* types of two variables over a set of at most parameters. 
Formally this means each pi is a subset of $ := {ip{x,y,Uj-^,...,Uj^) G A* : A: < 
^sJit jk G {Oi-'-i'Tia — 1}}. For all U £ H fix (ao,...,a/) some enumeration 
of A* (of course I < ms) and we then write tpA*{{a,b), A* ,dJl*[U]) = pi iff 
9Tt*[[/] \= Lp{a,b,aj^, ...,ajf.) <^ ip{x,y,Uj^, ...,Uj^) G Pi- Note that i* is uniformly 

bounded by 2 

•|-("-) 

. For all i < i* and [/ G il the 2-place relation on il defined for 
all i7 G il by {{x,y) G '^U : tpA*iix,y), A*" ,M*[U]) = pi} satisfies the induction 
hypothesis. Hence there exist a simple vocabulary cr' a formula ip^{x,y) and W a 
simple model for cr* on il such that for all C/ G il and a, 6 G U: 

OT' h V\a, b) ^ tpA' {{x, y),A*" , M*[U]) = p. 
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Without loss of generality we may assume that cr* has only function symbols. We 
use a theorem of Gaifman about models with a distance function (see [H]). We get 
that y) is logically equivalent to some local formula. This means for all [/ e H 
the truth value of (p^{x, y) in depends only on the type of (x, y) on the set of 

formulas Uje{i 2 3} where: 

*i := ° if^ o ...ff\x) =y:h, /, Ea\ee -1}, t < s} 

$2 {ff'^ o ff^ o ...ff\x) = X : A, ft G a\ e e -1}, t < 4 

and s = s(i) is a natural number that depends only on tp^. Define for each j G 
{1,2,3}: $j :=Uj<.- and $ = $1 U$2 U $3- Also define ct* ■=[j._^^,a' (w.l.o.g. 
the union is disjoint) and D^* is defined by (Vi < i*)9T*|cr* :— W. Using Gaifman 
theorem for all J7 € il and a, b, a', b' E U we have ({^): 

tp$((a, 6), 0, TV*) = tp$((a', 6'), 0, ^ ^PA- ((a, 6), A*, A/*) = tpA- ((a', 5'), M*) 

Note that |<i>| is uniformly bounded. Moreover the bound depends only on |A| and 
n. We treat each $ type separately this means: Let 9 be a type without parameters 
in (that is simply g C $). As we saw the number of such types is bounded by 
2l*l . As we saw in the beginning of the proof we are done if we interpret the relation 
Sq defined by: &[U] D {(a;,y,z) G : tp$((a;, y), 0, 9Ti [?7]) = q}. Clearly the 

relation {{x,y,z) G "+^C/ : ip$((a;, y), 0, 9Ti[C/]) = q} is definable from W by the 
formula (pq{x, y, z) :— A^gq 4' ^ A</.e$\g ~^4>- Now one of the following holds: 

(1) There exist d(x, y) G $1 such that 6 e q. Then for all [/ G it and a,b £ U 
we have: 

[tp$((a,fe),0,OT*[C/]) = g] =^ Dl* h 6'(a,&) 

(2) For all e{x, y) e <i>i, ^ q. Then for all [/ G il we have: 

{ix,y)e^U ■.tp^iix,y),(i),m*[U])^q}^{ix,y)eAqXBq:m*[U]\^ f\ -^e{x,y)} 

Where we define: 

Aq:={xeU : tp^^{x,(!>,m*[U]) = ^0*2} 

Bq:^{yeU: tp^, (y, 0, m*[U])^qn $3} 
Assume condition (1) is satisfied. Note that for all C/ G il, 0{x,y) defines in DT*[C/] 
a (graph of a) 1-1 function, note this function by /^. The relation defined by 
{{x, z) G "[/ : xS''^ m[u]^^ ^^^^^ ^ n-place relation definable form 9^ by a simple 
expansion (using the formula (yt)9{x,t) ^(^j^i^))- Hence there exist a formula 
(pi{x,z), a vocabulary cri and a model interpreting it. Now the formula 9{x,y)A 
(pi{x, z) A (pq{x, y, z) and the model for ui U a* which is the union of ?1* and 9li 
interprets &q as desired. 

We now assume that condition (2) is satisfied. Let J7 G it and c G "^^J7. We 
ask a question: 

<)^g Does there exist for all B C [/ with \B\ < and B D A*, elements 

a,b eU\B such that aS'^ fjr;[(7[^' ^ ip*((a, &), 0, 9^*[C^]) = 9- 
Assume that there exist U £ ii and c G "^^t/ such that the answer to <D^g is 
YES. Choose by induction on j < 7714 a pair {aj,bj) G such that: 
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• ip$((a,,6,),0,iV*) = 

• aj.bj ^ A* U {ttk ■■ k < j} U{bk ■■ k < j} U {cq, c„_2}- 

This is possible by the definition of TO5 and •O.^g. From the sequence (ao, (1^,4) we 
omit all the elements satisfying HiS^^^^-^ m'[u]^ where Ai and 9Jt' are taken from 
the symmetry lemma (see I6.5|l . We omitted at most Z*(Ai) elements. Now note 
that for all ji,j2- Iji^'a m^32^ ^ ^h^^2(A) m'[u]'^h^- Hence for all aj (after the 
change) we have \{hj : 0^5*^ M^jc}| < P(A2). Hence we can decrease the size of the 
sequences by a factor of l*{/^2) and get aiS'^ljhjC i — j. Since the bound on |$| 
depends only on n, |A| we may assume w.l.o.g (by increasing mi and using Ramsey 
theorem) that the $-type in N* without parameters of {uj^ , bj^ ) depends only on 
the order type of {ji,j2)- Hence we have sequences {uq, ami) and (6o,...,6mi) 
such that: 

(*) For all ji,j2 < mi: aj^S^ j^jb^^c ji = .72 • 
(**) For all ji, J2, J3, j4 < mi: 

tP{x<v,x=y}iUl,j2),^, (N, <)) = ip{2;<y,x=y}((j3, j4),0, (N, <)) =^ 

tp^ ( (a,, , 5, J , 0, TV*) = tp^ ( (a,3 , 6, J , 0, TV* ) . 

Now w.l.o.g we may assume that mi > l^i] (otherwise replacemi by maa;{mi, |$i|} 
in the definition of m4). Hence there exists < j* < mi such that: N* \= 
Ae(a; y)G*i ^("0' ^i*) (remember each 9(x,y) is a function). In addition by our 
definition tp$((ao, 60), 0, TV*) — q, hence by condition (2) oq G Aq. In addition we 
have bj, e Bq as tp,j>{{aj, ,bj*),(l), N*) = q, and hence tp$((ao, ), 0, TV*) = q (see 
condition (2)). In the same way we get that there exists < j** < mi such that 
ip$((aj«»,6„2),0,TV*) q. So by (**) we have i,j < nii ^ tp^{{ai,bj)S, N*) = q 
and by (0) we get: 

(***) Forallji,j2,j3,j4 <mi: tp^,{{a,„b^,), A* , M*) = tpA.{{a,,,b^J, A* , M*). 
We now prove: 

V There exists m* < m2 — mi = (mi)^ such that if {a',b') and {a",b") are 
pairs from Am*+mi that satisfy the same A*-type over Am* in M*, then 
a'Sl^Vc = a"Sljy,ib"c. 

Assume that ^ does not hold. Then for all m < m2 — mi let («„,&„) and 
{am,bm) be pairs from Am+mi realizing the same A*-type over Am* in Tlf*, and 
-^{a'S'^j^jb'c = a"S'lj^jb"c). Choose c™ G "Am+i reahzing tpA- (c™, Am, M*) (this 
is possible, see the definition of Am+i)- Now look at the formula 4){x,y) G A*. 
If Zi < ^2 < m2 — mi then (aj^,6;^) and (a"^,6"^) realizes the same A*-type over 
A12 in M* . Since c'l C (as h < I2) and since xi^iV,^) G ^* interprets 
the relation S\ j^.j in M*, we get that aJ^S'^+M^J^^ = a'l^S'^ljb'l^ hence TW* ^ 
(^((aj^, a"^, 6"^), c'l). On the other hand if mi +Z2 < ^i < m2 then by the choice of 
Ks'^L) a'^'i (o"2'^/2) as a counter example we have ^(oJ^S'^^m^J^c = aJ!,5'^_M^"2^)- 
But aj^, a"^ , fe"^ G Ai^j^mx ^ v4;^ and c'l realizes the same A*-type over Ai^ as c, 
so by the definition of </) and M* we have Af* ^(/^((aj^, a"^, 6"^), c'l). Hence if 
we define (dl = (aj.^^, : / < mi) and {JeJ = c' "i : / < mi^, then 

(j){x,y) defines an order relation in the sense of 16.71 on them, in contradiction to 
mi > k^{(j)). This completes the proof of ^. 
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Now let m* be the one from 'v'. For all I < mi we choose from Am*+i+i the 
sequence d^{a'-j,b''j : j < mi) that realizes the same A*-type over A,n'+i in M* 
as c^{aj,bj : j < mi). We will show that these sequences satisfy the demands of 
lemma Ffi.SI for the formula z). This will lead to a contradiction as mi > 

kl{x). (a) follows directly from (*) and the equality of types. For (/3) let li < 
I < mi and ji,...,j4 < mi. Then {a\\^b^j\) and {aj\,b'j-J are pairs from Am*+h 
and from (* * *) and the equality of types we get that these pairs realize the same 
A*-types over Am* +1-1 and in particular over Am* ■ So by ^ we have j\S2, M^j2^ = 
M^%^- conclusion as c and realizes the same A*-type over Am*+h and 
by the interpretation of the formula if) in M* we get M^h^^ = "is'^A Af^'l^' 

as in (/3). 

We are left with the case where for all [/ G il and c e "^^C/ the answer to 
0^5 is NO. In this case: For all G il and c G ""^[/ there exist B = Bg C 
U with size < m^ such that there are no u,v ^ B satisfying uS^^ ^^jj-^vz and 
tp$((u,w),0,D^*[?7]) — q. Define 1 a n-place relation on it as follows. For all 
[/ G it, a G [/ and c G "~^U: 1[U]{a,c) iff there exists B C U oi size < ms such 
that: 

• There are no u, u ^ B with: j^jj^juz and w), 0, D^* [C/]) = (7. 

• _B is minimal under the previous demand. 

• a e B. 

It is clear that T is definable from EH in a simple expansion, and hence satisfies the 
induction hypothesis. Let a** , if** (x, z) and 9T** be the formula, vocabulary and 
model that interprets T. We define mg := m^ ■ Delta{m^, 3) and show that for all 
t/ G il and c G ""^f/: 

\{xeU ■.W*[U]^^**{x,c)}\<mQ 

Assume towards contradiction that U and c does not satisfy that claim. Then by 
the definition of tp** we have a sequence {Bi C U : I < mj) such that: 

(1) For aU / < my, mg >\Bi\. 

(2) For all I < my, there are nou,v ^ Bi s.t. uS^ j^jj^jvc and tp^{{u, w), 0, 01* [?7]) = 

q- 

(3) For all I < mj, Bi is minimal under (1) and (2). 

(4) For aU;<m7, 2Um<i^™- 

(5) [ji<,nrBi^{x:m**[U]^ip**ix,c)}. 

To get this sequence we start with a sequence of all the sets satisfying claims (1)- 
(3) in some order, and omits those that do not satisfy claim (4). claim (5) follows 
straight from the definition of tp** . Now, by (1) and the assumption we get: 

mg < \{x : m** |= (p*ix,c)}\ = \ Ui^mv Bi\ < my • max{\Bi\ : / < mj} < mj- m^ 

so we have my > m^jm^. By the definition of mg and Ramsey theorem we have 
B* (- U and ^i < ^2 < ^3 < "^7 such that i ^ j ^ Bi. f] Bi^ = B* . We prove 
that B* satisfies (1) and (2). Since B* C Bi^ this will be a contradiction to the 
minimallity of Bi^. Obviously B* satisfies (1), to show (2) take some a,b ^ B* then 
by * 7^ j -B/. n Bi^ = B* we have j G (1, 2, 3} such that a,b ^ Bi. and since Bi. 
satisfies (2) we get -^aS^^\,jbc or f ), 0, 9l*[C/]) ^ g as needed. 

We use Gaifman theorem again on the formula (p**{x,z) (w.l.o.g a** have only 
function symbols). We get that for all J7 G il the truth value of 'f**{x, z) in M** [U] 
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depends only in the type without parameters of {x,z) in 9Jl**[C/] for the set of 
formulas ^ := Uje{i,2,3} where: 

*i := U!^'^ ° /2^'^ ° -ft^'Hx) = Zi : /i, ...,ft G (T**,6G *{1, -!},*< 8,i<n-l} 

^2 := {ff'^ o ff^ o ...ff'\x) = X : A, G a**, e G -1}, ^ < 4 

*3 := {/■^'^o/2^(2)o.../f(*)(z0 = z, : /i, ...,/, £ a**,ee ' {I, -l},t < .s,t, j < n-1} 

and s is a natural number that depends only on ip** . Note that \^!\ is uniformly 
bounded. Again we separate into cases according to the ^'-types. Let 91,(72 be 
^'-types without parameters (formally 171, (j2 ^ ^f). The number of such types is 
bounded by 2l*l so as we saw it is enough to interpret the relation &q defined 
by: 

eq[U] n {{x, y, z) G "+^C/ : tv^{{x, z), 9,^**[U]) = qi A tp^{{y, z), 9,^**[U]) = (72} 

The relation {ix,y,z) G "+^U : z), 0, TV**) = qi Atp^{{x,y),9, N**) = q^} 

is definable in 91** by a formula noted ipq^^q^{x,y, z). Now, for Z G {1, 2} one of the 
following hold: 

(1) There exists 6{x, Zi) G *i such that 6 & qi. Then for all f/ G it, a G f/ and 
c G "~^C/ we have: 

[ip*((a,c),0,<n**[C/]) = qi] =^ ^**[U] \= 6{a,Ci) 

(2) For all e{x, zi) G $1, 6I ^ qi. Then for all C/ G il we have: 

{{x,z) G "C/ : tp<,{{x,z),%,^**[U]) = qi] = {{x,z) G A^xB; : ^**[C/] h A -^(^'^^)} 

6'(a:,Zi)e*i 

where wc define: 

A'q^ :={xeU: tp^^{x, 0, m**[U]) = qi n ^2} 

B'q^ := {z G "-^C/ : tp*, (z, 0, [C/]) = n $3} 

Assume that there exists I G {1,2} such that (1) holds. Then, as we have seen, 
6{x, Zi) defines in each OT** [U] (a graph of) a one to one function. Note that function 
by /". the relation defined by: 

{{x,y,zo, ...,Zi, Zn-2) G "f/ : xS^^^ffji^u^y, zq, Zi-i, (x), Zi+i, Zn-2) 

satisfies the induction hypothesis. Let (p^{x, y, zq, Zj, ..., jn-2) be the formula in 
vocabulary that interprets this relation in the simple model 01^. In the same 
way we interpret the relation defined by: 

{{x,y,zo,...,Zi,...,Zn-2) G "?7 : xS^j^^^j^y, zq, Zi_i, {y), z 

using the formula f'^ix, y, Zq, ...,Zj, z„_2) in the vocabulary and the simple 
model Vt^. Now the formula <fiq{x, y,z) A fqi,q2 {x^ y,z) A (p'{x,y, za, zj, .... , 7,1-2) 
in the vocabulary a* U a** U ct' and the union of models: 91**, 01*, 01', interprets 
the relation &q,qi,q2 as needed. 

Assume then that for each I G {1,2} (2) holds. Seeking a contradiction we 
assume that there exists U G ii such that: 

• e,,,„<,,[c/]^0. 

• For all / G {1,2}, \A'q^ \ > mg + 
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So we have a,b & U and c £ "^^J7 such that &q.q^^q2[U]{a,b,c). Reeah that we 
are assuming ^O^g, Hence we have 91** |= ip**{a,c) V (p**{b,c), because we can 
choose some minimal (there is one because of ~^(}^c) then a,b ^ is 
contradicting the definition of Be- w.l.o.g we assume that OT** |= f**{a^ c). Now qi 
satisfies (2) so c G B'^^ as tp^{{a,c),%,N**) = qi. Note that \{a' e A'^^ : W*[U] ^ 
f\e(x zije*! < l^*!] (again each 9{x,Zi) is a function) and hence A'^^ has 

more than mg (distinct) elements {ao, ...flmg} satisfying fp5r((ai, c), 0, ^Tl** [J7]) = qi. 
But we also have tp^{{a, c), 0, ^n** [J/]) = qi and 91** |= v?* (a, c), so for aU < i < 
mg, *Jt** ^ (p**(ai,c) which is a contradiction. 

Finally we assume that there is no J7 S 11 satisfying the two demands above. We 
then divide iX into three parts iti : z G {1, 2, 3} such that: 

• =0^C/ Gill. 

. \Af^ \ <m6 + |*i| ^C/Gil2. 

. \AfJ <m6 + |*i| ^C/Gil2. 
By our assumption U,ig{i^2,3}lii ~ ^- Now for each i G {1,2,3} it is easy to 
interpret 65,51,53 restricted to 11^ (using the formula {3x)x 7^ x, or by adding a 
bounded number of constants to the vocabulary interpreted as the elements of A'^ 
or A'^ and using the induction hypothesis). Assume then that for each i G {1, 2, 3} 
the formula ip***{x,y,z) in the vocabulary a*** interprets in the model 01***, the 
relation 65,5^,52 restricted to iX^. We now define a*** ~ Uig{i^2,3}0'.r** U {si, S2, S3} 
(w.l.o.g the union is disjoint), and a model «H*** for a***, such that for each i G 
{1,2,3}: {m***\ik)\cr*** := 91***, and for all C/ G il, sf"*''^' ^ iff ?7 G U,. (if 
i ^ j the definition of (91***|iti)|o-*** is insignificant). Now the formula: 

(p***{x,y,z) := y {3usi{u)) — > ip***{x,y,z) 
je{i,2,3} 

interprets 65,51,52 the model 91*** as required. This completes the proof of 
lemma QUI ' ' □ 

In the second stage of proving theorem 16.91 we interpret 91 itself. We prove the 
following: 

Lemma 6.11. There exist a simple vocabulary a, and a finite set $ of formulas in 
a, and a simple model 91 for a on H. Such that for all U G il and x, x' G "(^^C/ if 
ip$(S,0,91[;7]) = tp<i,(x',0,91[C/]) then (C/,91[C/]) h r{x) = r(x')- 

Proof. Define: A :— {r(xa, Xn{<}i)~i)}, and we note the first variable by x and 
the last n variables by y (so A :— {r{x, y)}). 

We define a and simultanios and also we define 91 [J7] for some [/ G il. Let 
a,a' e U and 6,F G "f/, and assume that tp^{ab,0,m[U]) = ip<i,(a'6', 0, 91[[/]), 
where a, $ and 91 will be defined. 

Let ffQ, (po{x,y) and 97lo be those who interpret 2;S'2 (jjjjjyjy, i-c. those we get 
from applying the previous lemma to A (where r = and 9Jl = 91) . For gravity we 
write M = m[U], m[U] = N, ^o[U] = No and R = m[U]. We add ctq to a, (po to 
$ and demand iV|CTo = Nq. Now we have: 

aSl,,b^a'Sl,jF 

We write E = E^^i, and define A* = Ap^'^ U {x : \x/E\ < 2 • k^{A)}. for aU 
a & A* we add to cr a constant Cq and put := a. In addition for each equivalence 
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class xjE we add to cr a 1-place relation symbol s^jE and put s^i^ :— x/E. Note 
that both \A* \ and the number of equivalence classes is uniformly bounded. We add 
to $ formulas of the form x = c and Ui = c for each constant c G cr, and formulas 
of the form s{x) and s{yi) for each relation symbol s £ cr. Now for each constant 
c e cr the relation class on U, 5Rc defined by yic[U'] ^[U']{c^^'^'\y) satisfies 
the induction hypothesis. That is it is a class of n-place relation not satisfying 
condition (1) in theorem 13.71 Hence we can add to a and $ the dictionaries and 
formulas we get from applying the induction hypothesis to each Die, and expand 
0^ accordingly. Assume a € A* , then (due to the formula x = Co) we have a = a'. 
Because of the formulas we added to $ for the relation [Hc„ we have: 

This implies R{c^ ,b) ee i?(c^,F). But since = a = a' = we get R{a,b) = 
R{a', b'), as claimed. This proves the cases a ^ A* and a' ^ A* . 

Now for each x/E (where x ^ A*) and y G "C/ we define t^^'^ G {T,F} to be 
the truth value the formula r(— , y) gets for the majority of elements in x/E. This 
means: t"^^^ = T iff \{x' : xEx' A R{x',y)}\ > fcJ'(A). Note that this is true as 
x ^ A* and so \x/E\ > 2 • fci(A). We get: 

^aSl,,b^[R{a,b)^{tl^'' 

and since A has only one formula we get: 

aSl,,b^[Ria,b)^{t;/'' ^¥)] 

For each x/E we have a class of relations ^x/e on ii defined by JHa;/£;[[/'] := {y £ 
"[/' : t^^'^ — T}, which satisfies the induction hypothesis. Hence we can add to a 
and <i> the dictionaries and formulas we get form applying the induction hypothesis 
to each DIx/e and expand 71 accordingly. We get for all x ^ A* : 

mx/E[u]ib) = mx/E[uW) 

Since a/E = a'/E (due to the formula Sa/£;(a;)), we have t"^^^ = . Assume 
-^aS^i j^jib (as we saw aS'^/ m'^ = cl'^a' m'^') have: 

R{a, b) ^ (tl'^ = T) ^ (t^/^ = T) ^ (t^/^ = T) ^ R{a\y) 

as claimed. If aS\, j^pb then again we get: 

i?(a, b) ^ [t'^'^ = F) ^ (t^/^ = F) ^ {ty''^ = F) ^ i?(a',F) 
This completes the proof of lemma IS. Ill □ 

From the lemma it is easy to prove that d\ is interpretable by a formula in a 
simple model. The proof is identical to the 2-place case (see the proof of l5.8|l . This 
completes the proof of theorem Iti. 91 □ 
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